Information dynamics: Temporal behavior of uncertainty 

measures 



Piotr Garbaczewski 
Institute of Physics, University of Opole, ^5-052 Opole, Poland 

We carry out a systematic study of uncertainty measures that are generic to dy- 
namical processes of varied origins, provided they induce suitable continuous prob- 
ability distributions. The major technical tool are the information theory methods 
and inequalities satisfied by Fisher and Shannon information measures. We focus on 
a compatibility of these inequalities with the prescribed (deterministic, random or 
quantum) temporal behavior of pertinent probability densities. 

Keywords: Information functionals; information theoretic inequalities; Shannon entropy; 
Fisher information; dynamics of probability densities; entropy methods; Smoluchowski pro- 
cesses; Schrodinger picture evolution. 
PACS numbers: 03.65.Ta, 02.50.Ey, 05.40. Jc 

I. INFORMATION AND UNCERTAINTY 

Our primary motivation is an information-theoretic conceptual background and methods 
of analysis adopted for probability distributions. Such notions like information, uncertainty, 
indeterminacy and/or information deficit are naturally quantified in terms of information 
inequalities. A relationship between statistical (informational) and thermodynamic notions 
of entropy of a physical (model) system, has received some attention as well,— ^'2^. 

The pertinent information measures are seldom considered in the time domain. Our 
main purpose is to quantify their temporal behavior, while taking for granted that dynam- 
ical processes of interest do induce suitable continuous probability densities, see e.g.- 1 ^^. 
A particular attention is paid to the time evolution of information entropies and inferred 
uncertainty measures^^. 



A. Entropic functionals 



To facilitate further discussion, we shall not attempt a fully fledged space-time formalism, 
and pass to time-dependent model systems in one space dimension. Let us consider con- 
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tinuous probability densities on the real line, with or without an explicit time-dependence: 
p G J R p(x)dx = 1. Our minimal demand is that the first and second moments of 

each density are finite. 

Therefore we can introduce a two-parameter family p aa (x), labeled by the mean value 
(x) = J x p(x) dx = a G R and the standard deviation (here, square root of the variance) 
a e R + , a 2 = {(x- (x)) 2 }. 

For a given probability density p we name a function — In p(x) a surprise level function 
and identify its mean value with the familiar notion S(p) of the Shannon entropy of a 
continuous probability distribution, c.f.-: 

S(p) = — (lnp) = — J p(x) \np{x)dx . (1) 

Let us assume p(x) to be (weakly) differentiable, so that we can give meaning to its first, 
second and third derivatives. 

Besides an obvious information-theoretic notion of the Shannon entropy, we introduce 
another information-theory functional J-{p), often named the Fisher information measure 
(the name originates from the statistical inference theory): 

^(p) = ((Vlnp) 2 ) = J^dx. (2) 

The above introduced expressions In p(x) and V In p allow to infer a number of interesting 
formulas. We assume the natural boundary data at finite or infinite (employed in below) 
integration boundaries. We have: 

-Vlnp = -^^-(^) = (3) 
P P 

and next 

_ Alllp = _^ + (Ef =» -<Alnp> = = <(Vln^> . (4) 

P P Z p Z 

The following identities hold true: 

Ap 1 / 2 1. Ap l(Vp) 2 n ^AP V \ A1 n 

where we encounter a potential for a "Newton-type force field" . Its functional formula should 
be compared with Eq. (jlj) . The mean value of the potential function is non- negative 

while this of the related "force" vanishes: 

<v(^r)> = o. (7) 
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In the above systematics of derivatives there was no indication of a specific physical con- 
text. Nonetheless a number of physically interesting quantities can be immediately recog- 
nized. They do notoriously appear in the local conservation laws for diffusion-type processes 
and in the hydrodynamical formulation of the Schrodinger picture quantum dynamics 7,8 . 

Namely, while keeping in mind (hitherto disregarded) dimensional coefficients, we realize 
that Eq. (3) introduces a functional expression for an osmotic velocity field. Eqs. (4) and 
(5) actually set links between the hydrodynamical-type pressure function 8 and the Fisher 
functional. Eqs. (6) and (7) relate the so-called quantum potential and the pressure. Eq. (8) 
demonstrates that the mean value of a (known as quantum) potential and the value of the 
pressure functional do coincide, while Eq. (8) tells us that the mean value of the inferred 
(quantum) force necessarily vanishes. 

Let us emphasize that our only input was a surprise level function — In p(x) for a con- 
tinuous probability density p on R, admitting first and second moments, with suitable 
differentiability properties and natural boundary data being implicit. No specific physical 
motivations (like e.g. quantum or random dynamics) were spelled out. 



B. Information inequalities 

Let us consider a one-parameter a-family of densities whose mean square deviation value 
is fixed at a. We have 

S(p) < (1/2) ln(27rea 2 ) (8) 

with a maximum for a Gaussian probability density with the prescribed fixed standard 
deviation o. By introducing the mean value: 

([a 2 Vlnp + (x- (a;))] 2 ) > (9) 

we readily arrive at an inequality 

Hp) > 3? ( 10 ) 

in which a minimum of T is achieved (among all densities with a fixed value of a) if and 
only if p is a u-Gaussian, that in parallel with a maximum for S, compare e.g.- 1 ^. 

We stress that the above information inequalities Eq. (jHJ) and ( fTOl) set respectively lower 
and upper bounds upon Fisher and Shannon functionals, while evaluated with respect to 
any density in the set of all admissible ones (e.g. with once fixed for all standard deviation 
value a). 

Although we have carefully avoided any impact of dimensional quantities, the above 
Eq. (jTUl) actually associates a primordial "momentum-position" indeterminacy relationship 
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(here, devoid of any quantum connotations) with the probability distributions under consid- 
eration. Namely, let D be a positive diffusion constant with dimensions of h/2m or kBT/mf3, 
c.f.-. We define an osmotic velocity field u = u(x) = DVlnp. There holds: 

Ax-Au>D (11) 

which correlates the position variance Ax = ([x — (x)} 2 ) 1 ^ 2 with the osmotic velocity variance 
Au = ([u- {u)} 2 ) 1 ' 2 . 

This property extends to time-dependent situations and is known to be respected by 
diffusion-type processes^. Its primary version for the free Brownian motion has been found 
by R. FiirtbA 

As well, not accidentally, the above formula closely mimics, and in fact induces (through a 
reasoning based on probabilistic arguments) the fully-fledged quantum mechanical position- 
momentum relationship Ax ■ Ap > h/2, (tentatively replace u by mu and set h/2 instead of 
D, see e. g.— . We shall come back to this point in below. 

To conclude this section, let us point out that, given p(x) and a suitable function f(x), we 
can generalize the previous arguments. Let us introduce notions of a variance and covariance 
(here, directly borrowed from the random variable analysis^) for x and f(x). By means of 
the Schwarz inequality, we get: 

<[* - <*>] 2 > ■ ([/ - </>] 2 > > «[* " (*>] " ([/ " </>]» 2 , (12) 

hence, accordingly 

Var(x) ■ Var(f) > Cov 2 (x, f) . (13) 

We note that for an osmotic velocity field u(x), we have (u) = and (x-u) = —D. Therefore 

Var(x) ■ Var(u) > Cov 2 (x, u) = D 2 , (14) 

as anticipated in Eq. (iTTj) . 

The casual intuition behind physics-motivated indeterminacy relations is that of the 
Fourier transform. Indeed, for functions in L 2 (R) a non-zero function and its Fourier trans- 
form cannot be both sharply localized. 

Let us point out remarkable information-theory inequalities^: 

F(p) > (27re) exp[-2«S(p)] > 1/a 2 . (15) 

and note that an explicit Fourier transformation input allows to set an upper bound in this 
chain of inequalities. 

The crucial step is to disentangle the L 2 (R) ingredients in the ^(R) functional form of the 
density p. This can be accomplished on many ways, the simplest is either a multiplicative 
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decomposition p(x) = p 1 ^ 2 (x) ■ p 1 ^ 2 (x), where clearly p 1 / 2 e L 2 (R). More general choice 
involves a complex function G L 2 (R) and its complex conjugate <fi* so that p = 0-0* = |0| 2 . 
(We recall that the Fourier transform of a real function typically is a complex function.) 

Given an L 2 (i?)-normalized function ip(x). We denote {J-ip){p) its Fourier transform. 
The corresponding probability densities follow: p(x) = \ip(x)\ 2 and p(p) = \(J-'ip)(p)\ 2 . 
We introduce the related position and momentum information (differential, e.g. Shannon) 
entropies: 

S(p) = S q = — (hip) = — J p{x) In p{x)dx (16) 

and 

S{P) = S P = -(hip) = -J p{p)\np{p)dp (17) 

where S denotes the Shannon entropy for a continuous probability distribution. For the 
sake of clarity, we use dimensionless quantities, although there exists a consistent procedure 
for handling dimensional quantities in the Shannon entropy definition. 

We assume both entropies to take finite values. Then, there holds the familiar entropic 
uncertainty relation which is the sole consequence of the Fourier transform properties in 
L 2 (R)^: 

S q + S p > (1 + lnvr). (18) 

Let us notice that in view of properties of the Fourier transform, there is a complete 
symmetry between the inferred information-theory functionals. After the Fourier transfor- 
mation, the Parceval identity implies that the chain of inequalities Eq. (fT5l) can be faithfully 
reproduced (while replacing p by p) for the "momentum -space" density p with the variance 
a 2 . As a consequence, taking into account the entropic uncertainty relation Eq. (fTBl . we 



arrive at^: 

Aa 2 > 2(e7r)" 1 exp[-2(lnp)] > (2eir) exp[2(lnp)] > a' 2 (19) 
which adds a Fourier transform-inferred upper bound to the previous inequalities Eq. ( |T5l) 

4a 2 > T(p) > 1/a 2 (20) 

and sets related upper and lower bounds upon the Shannon entropy as well. 



All that has been considered with no mention of any time evolution. Since the dynamics 
has a physical provenance, we should carefully investigate the p-factorization issue and an 
impact of a priori given dynamical rules for po{x) —>■ p(x,t) upon its concrete realisation. 
We shall focus on the standard random dynamics (Smoluchowski processes and phase-space 
motion) and the Schrodinger picture quantum dynamics. 
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II. QUANTUM INDETERMINACY IN THE TIME DOMAIN 

If following conventions we define the squared standard deviation value for an observable 
A in a pure state ip as (AA) 2 = (?/>, [A — (A)] 2 ip) with (A) = (ip, Atp), then for the position 
X and momentum P operators we have the following version of the entropic uncertainty 
relation (here expressed through so-called entropy powers, see e.g.-, % = 1): 

AX-AP>^- exp[5(p) + S(p)} > i (21) 

which is an alternative version of the entropic uncertainty relation. For Gaussian densities, 
(27re)AX • AP = exp[<S(p) + S(p)] holds true, but the minimum 1/2 on the right-hand-side 
of Eq. (I2TI) . is not necessarily reached. 

Let us consider a momentum operator P that is conjugate to the position operator X 
in the adopted dimensional convention H = 1. Setting P = —id/dx and presuming that all 
averages are finite, we get: 

[(P 2 ) — (P) 2 ] = (AP) 2 = a 2 . (22) 

The standard indeterminacy relationship a ■ a > (1/2) follows. 

In the above, no explicit time-dependence has been indicated, but all derivations go 
through with any wave-packet solution ip(x,t) of the Schrodinger equation. The induced 
dynamics of probability densities may imply the time-evolution of entropies: S q (t), S p (t) and 
thence the dynamics of quantum uncertainty measures AX(t) = a(t) and AP(t) = cr(t). 

We consider the Schrodinger equation in the form: 

j^ = -DA^ + ^=rV- (23) 

where the potential V = V(x ,t) (possibly time-dependent) is a continuous (it is useful, if 
bounded from below) function with dimensions of energy, D = H/2m. 
By employing the Madelung decomposition: 

ip = p 1/2 exp(is/2D) , (24) 

with the phase function s = s(x,t) defining a (current) velocity field v = Vs, we readily 
arrive at the continuity equation 

d t p = -VM (25) 
and the generalized Hamilton- Jacobi equation: 

d t s + l-(Vs) 2 + (n-Q) = (26) 
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where Q = V/m and, after introducing an osmotic velocity field u(x,t) = DV\np(x,t) we 
have, compare e.g. our discussion of Section I: 



Art 1 / 2 1 

Q = 2D 2 ^ jr = ^u 2 + DV-u. (27) 

If a quantum mechanical expectation value of the standard Schrodinger Hamiltonian 
H = -(h 2 /2m)A + V exists (i.e. is finite^), 

(ip\H\ip) = E < oo (28) 

then the unitary quantum dynamics warrants that this value is a constant of the Schrodinger 
picture evolution: 

H = ^[(v 2 ) + (u 2 )] + (Q)=- (d t s) = £ = - = const. (29) 
Let us notice that (u 2 ) = —D(Vu) and therefore: 

We observe that D 2 T stands for the mean square deviation value of a function u(x,t) 
about its mean value (u) = 0, whose vanishing is a consequence of the boundary conditions 
(here, at infinity): 

(Au) 2 = a 2 u = ([u-(u)) 2 ) = (u 2 ) = D 2 T. (31) 
The mean square deviation of v(x,t) about its mean value (v) reads: 

(A^) 2 = °l = (v 2 ) - (v) 2 • (32) 

It is clear, that with the definition P = —i(2mD)d/dx, the mean value of the operator P is 
related to the mean value of a function v(x,t) (we do not discriminate between technically 
different implementations of the mean): (P) = m(v). Accordingly, 

a 2 = (AP) 2 = (P 2 ) - (P) 2 (33) 

Moreover, we can directly check that with p = \ip\ 2 there holds 15 : 



HP) = = I dx\^'(x)/^(x) + r'(x)/r(x)] 2 = (34) 



4/^'W(*) + /^ 

' ■KP 2 )-m 2 (v 2 )] = ^-[(AP) 2 -m 2 a 2 v ] 



m?D 2 m?D 2 
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i.e. 

m\al + al)=a\ (35) 

It is interesting to notice that ((P — mv)) = and the corresponding mean square deviation 
reads: ((P — mv) 2 } = (P 2 ) — m 2 (v 2 } = m 2 D 2 J z ' . 

By passing to dimensionless quantities in Eqs. (IMl) (e.g. 2mD = 1), and denoting 
p d = (arg if)(x,t))' we get: 

T = 4[(P 2 ) " (Pi)] = 4[(AP) 2 - (A Pd ) 2 ] = A[a 2 - a 2 ] (36) 
and therefore the chain of inequalities Eq. ( Tl5l) gets a sharper form: 

4a 2 > 4[a 2 - a 2 d \ = T> (27re) exp[-25(p)] > \ . (37) 

We recall that all "tilde" quantities can be deduced from the once given if) and its Fourier 
transform if>. 

As a side comment let us add that a direct consequence of the mean energy conservation 
law Eq. ([29D are identities: (P 2 ) /2m = E - (V) and 

t = -^{( p2 ) ~ ™V>] = - (n» - (^ 2 )] (38) 

plus a complementary expression for the variance of the momentum observable: 

771 

(AP) 2 = 2m(E~([-(v) 2 + V})). (39) 
That combines into the chain of inequalities between various energy characteristics: 

E- (V) > m(v 2 )/2 > m(v) 2 /2 > 0. (40) 

III. INDETERMINACY RELATIONS FOR DIFFUSION-TYPE PROCESSES 

Let us consider spatial random motions, like e.g. standard Smoluchowski processes and 
their generalizations. Let us consider x = b(x,t) + A(t) with {A(s)) = 0, (A(s)A(s')) = 
\/2D5(s — s') and the corresponding Fokker-Planck equation for the probability density p 
which we analyze under the natural boundary conditions: 

d tP = DAp-V-(bp) (41) 

which we analyze under the natural boundary conditions. 

We assume the gradient form for the forward drift b = b(x, t) and take D as a diffusion 
constant with dimensions of hsT/infi. By introducing u(x,t) = DV In p(x,t) we define the 
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current velocity of the process v(x,t) = b(x,t) — u(x, t), in terms of which the continuity 
equation d t p = —V(vp) follows. The diffusion current reads j = vp. 

As mentioned before, we have an obvious indeterminacy relationship for the osmotic 
velocity field Var(x) ■ Var(u) > Cov 2 (x,u) = D 2 . The corresponding relationship for 
the current velocity field Var(x) ■ Var(f) > Cov 2 (x, f), contrary to the previous quantum 
reasoning, does not naturally yield any analogue of the Heisenberg-type position-momentum 
uncertainty formulas, c.f. Eq. (35). 

The cumulative identity Var(x) ■ \Var{u) + Var{v)] > Cov 2 (x,v) + D 2 , reproduced in 
Ref.— , does not convey any useful message about the diffusion process. It cannot be directly 
inferred from the Fisher functional J-"(p) which actually was the case in our previous, quan- 
tum discussion, e.g. where we have had VarP = Varimu) + Var(mv). For spatial diffusion 
processes, the latter identity is plainly nonexistent, since there is no diffusive analogue of 
the quantum momentum observable. 

Let us mention an early attempt 16 to set an uncertainty principle for general diffusion 
processes. If adopted to our convention (natural boundary data), in view of (u) = and 
v = b — u, we have (v) = (b). 

For an arbitrary real constant C ^ 0, we obviously have: [C ■ (v — (v)) + (x — (x)] 2 > 0. 
The mean value of this auxiliary inequality reads: 

C 2 (Av) 2 + 2C[-Cov(x, b) + D} + (Ax) 2 > . (42) 

and is non-negative for all C, which enforces a condition 

[D + Cov(x, b)} 2 - (Av) 2 ■ (Ax) 2 < . (43) 

Note that Cov(x,v) = D + Cov(x,b), so we have in fact an alternative derivation of the 
previous indeterminacy relationship Var(x) ■ Var(v) > Cov 2 (x,v) for the current velocity 
field. 

In case of Smoluchowski processes, forward drifts are proportional to externally imposed 
force fields, typically through b = F/m(3. Therefore the position-current velocity dispersion 
correlation is controlled by Cov(x, F). For the free Brownian motion (e.g. the Wiener 
process) we have 6 = 0, and hence Cov(x,v) = D. 

To get a deeper insight into the "position- momentum indeterminacy issue" for diffusion 
processes, let us begin from a classic observation that, once we set b = with 
$ = a substitution: 

p(x,t) =0*(z,t)exp[-$(z)] (44) 

with and $ being real functions, converts the Fokker-Planck equation Eq. (|4ip into a 
generalized diffusion equation for 9*: 

d t 9* = DA9* - (45) 
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and its time adjoint 

d t 9 = -DA6 + (46) 
2mD v ; 

for a real function 6(x,t) = exp[— $(x)], where 



.2 



^5 = + V ' = f [(V#) z - A*] . (47) 

Let us note an obvious factorization property for the Fokker-Planck probability density: 

p(x,t) = 0(x,t) ■ 0*(x,t) (48) 

which stays in affinity with a quantum mechanical factorization formula p = albeit 
presently realized in terms of two real functions 9 and 8*, instead of a complex conjugate 
pair. 

Let us mimic basic steps, outlined in Eq. (34) for the complex factorization of p, but in 
terms of two real functions 6 and We have: 

Hp) = ^1 = J dx(99*) [j + 6 f] 2 = (49) 



4 J dx&jtf + J dx(ee*)[ 



6' 9* l2 



6* 

Since a continuity equation d t p = — Vj is identically fulfilled by 

j(x, t) = p(x, t)v(x, t) = D(9J70 - 9^9,) (50) 

we obviously get: 

Hp) = Hp = m.) = 4 J dx(ve)(ve*) + ±<« 2 > = -^(v) + i> 2 > , (51) 

to be compared with the quantum mechanical result: 

Hp = H 2 ) = * J dxW) W) - -^ 2 > = ^[2(f - (n» - (^ 2 )] . (52) 

By reintroducing Q = V/m in Eq. (l5Tj) : 

^(p = ^) = ^[-2(fi) + (^ 2 )] (53) 

we achieve a notational conformity with Eq. (|52|) . 

The major difference between the formulas Eq. fl53l and Eq. fl52|) . apart from the presence 
or absence of an additive term S G -R, is that a diffusive potential V has a pre-determined 
functional form, Eq. (T4T|) . Our general restriction on V, irrespective of whether this potential 
enters the Schrodinger or the generalized heat equations, is that it should be a continuous 
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and bounded from below function^. In the diffusive case this demand guarantees that 
exp(— tP) with H = —DA + (l/2mD)V is a legitimate dynamical semigroup operator. 
Let us add that 

2 ,mv 2 , ,mv 2 mu 2 , , , 

^ = ""- ) = ^ < — - v> ^<— - — - v> = (54) 

while 

,w , , ,9\ 2 ri _, .mw 2 ,mf 2 mu 2 ,_, 

^(P = M ) = ^2 " (— + V )] =► (— + — + V > = E ■ (55) 

The variances of osmotic and current velocity fields are correlated, respectively, as follows 
p = e6*^ m 2 [(Au) 2 - (Av) 2 ] = 2m{^£ - (V)] (56) 

and 

p = ^* m 2 [(A«) 2 + (Aw) 2 ] = 2m[E - (^L + (y)] = (AP) 2 . (57) 

Since (Au) 2 > D 2 /a 2 , in view of Eqs. (57) and fl35l) we readily arrive at the standard 
quantum indeterminacy relation for position and momentum observables AP • AX > mD. 

In case of diffusion- type processes we definitely encounter a non-standard situation. On 
the left-hand-side of Eq. fl56l) . there appears a difference of variances for the current and 
osmotic velocity fields, instead of their sum, like e.g. in Eq. (l5"Tj) . This expression is not 
necessarily positive definite, unless (V) < for all times. 

Let us make a guess that An > Av, in the least locally in time (in a finite time interval). 
Then, the resulting expression 

m 2 (Au) 2 = mV> = 2m(^f - V) = (Ap u ) 2 > , (58) 

as we already know, yields a dimensionally acceptable position-momentum indeterminacy 
relationship for diffusion-type processes, 

Ax • Ap u > mD , (59) 

where Ap u > may be interpreted as the pertinent "momentum dispersion" measure. For 
the free Brownian motion we have V = and v = —u, hence Eq. ffTTl) is recovered. 

Upon making an opposite guess i. e. admit Av > Au (again, at least locally in time), in 
view of T > l/cr 2 , we would have 



m 2 {Avf = m 2 {Au) 2 + 2m[(V> - = {Ap v f > ^f- (60) 



and thus 

Ax • Ap v > mD (61) 

would ultimately arise. 



12 



The above two indeterminacy options (|59|) and fl6TT) are a consequence of a possibly 
indefinite sign for a difference Am — Av of standard deviations, in the course of a diffusion 
process. This sign issue seems to be a local in time property and may not persist in the 
asymptotic (large time) regime. We shall give an argument towards a non-existence of a 
fixed positive lower bound for the joint position-current velocity uncertainty measure in the 
vicinity of an asymptotic stationary solution of the involved Fokker-Planck equation. 

In case of Smoluchowski diffusion processes we may take for granted that they asymp- 
totically approach^ unique stationary solutions, for which the current velocity v identically 
vanishes. Then Av = as well, while < Var(x) < oo ( e. g. Ax stays finite). 

In view of Eq. ( |54l) . an asymptotic value of the strictly positive Fisher functional T 
equals —(2/mD 2 )(V) > 0. Accordingly, to secure T > 0, an expectation value of V with 
respect to the stationary probability density must be negative. Even, under an assumption 
that V is bounded from below. 

Consequently, in the large time asymptotic we surely have (Am) 2 > (l/cr 2 ) > (At>) 2 and 
Av — > 0, while a has a finite limiting value (an exception is the free Brownian motion when 
a diverges). The validity of the above argument can be checked by inspection, after invoking 
an explicit solution for the Ornstein-Uhlenbeck process^. 

Thus, Ax • Ap v > mD does not hold true in the vicinity of the asymptotic solution. On 
the contrary, Ax ■ Ap u > mD is universally valid. 

IV. ENTROPY METHODS: THERMODYNAMIC AL PATTERNS OF 
BEHAVIOUR IN DIFFUSION-TYPE PROCESSES 

A. Thermodynamical hierarchy 

Diffusion processes stand for an approximate description of (macro)molecules whose mo- 
tion is induced by a thermal environment. As such they quantify the dynamics of non- 
equilibrium thermodynamical systems. 

The following hierarchy of thermodynamical systems is adopted in below: isolated with 
no energy and matter exchange with the environment, closed with the energy but no matter 
exchange and open where energy-matter exchange is unrestricted. We keep in mind a stan- 
dard text-book wisdom that all isolated systems evolve to the state of equilibrium in which 
the entropy reaches its maximal value. An approach towards equilibrium is here interpreted 
as an approach towards most disorderly state. 

Our further attention will be focused on non-isolated, albeit closed, random systems and 
their somewhat different asymptotic features. Assuming the natural boundary data£>2&^, we 
shall introduce basic thermodynamical concepts and recall the Helmholtz extremum principle 
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for an intrinsically random motion. Thermodynamic function(al)s, like e.g. an internal 
energy, Helmholtz free energy and entropy will be inferred, through suitable averaging, from 
a priori prescribed time- dependent continuous probability densities. 

A concise resume of a non-equilibrium thermodynamics of closed systems comprises the 
I st law U = Q + W and the II nd law S = S int + S ext , where S int > and S ext = Q/T, 
cf.iSia. We are fully aware that not all objects involved (like e.g. Q can viewed as legitimate 
analogs of thermodynamic functions. Nonetheless, in the forthcoming discussion, the heat 
exchange and work time rates are always well defined and an issue of "imperfect differentials" 
is consistently bypassed. 

Thermodynamical extremum principles are usually invoked in connection with the large 
time behavior of irreversible processes. Among a number of standard principles, for reference, 
we recall a specific one named the Helmholtz extremum principle. If the temperature T and 
the available volume V are kept constant, then the minimum of the Helmholtz free energy 
F = U — TS is preferred in the course of the system evolution in time, and there holds 
F = -TS int < 0. 



B. Thermodynamics of random phase-space motions 

Let us consider a phase-space diffusion process governed by the Langevin equation mx + 
m'yx = -VV(i,t) + £(£), with standard assumptions about properties of the white noise: 



(£(0) = 0' = V^niksT 5(t — t'). Accordingly, the pertinent phase-space density 

w = w(x, u, t) is a solution of the Fokker-Planck-Kramers equation with suitable initial data: 

d 

—w(x,u,t)= (62) 



-— u + — 7u+— W(x,t)' 



to 



dx du \ m ) m dv? 

Let us define the Shannon entropy S = S(t) of a continuous probability distribution in the 
phase-space of the system: 

S(t) =— J (win w) dxdu = —(Into) (63) 

(By dimensional reasons we should insert a factor h with physical dimensions of the action 
under the logarithm, i.e. use hi(hw) instead of \iaw, but since we shall ultimately work with 
time derivatives, this step may be safely skipped.) 

An internal energy U of the diffusion-type stochastic process we define as follows: U = 
(E), where E = E(x,u,t) = H y^- + V(x,t). Then, the I st law of thermodynamics takes the 



2 

form 



Q + W = U (64) 
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where W = (d t V) is interpreted as the work externally performed upon the system. (For 
future reference we would like to stress a particular importance of the time-dependent work 
term in quantum theory.) 

Furthermore, let us introduce an obvious analog of the Helmholtz free energy: 

F= (E + k B T\nw) = U-TS (65) 

so that 

F-W = Q-TS = -TS ira < . (66) 

The above result is a direct consequence of the Kramers equation. Under suitable assump- 
tions concerning the proper behavior of w(x, u, t) at x, u integration boundaries (sufficiently 
rapid decay at infinities) we have^ Q = 7 (fc B T - (mu 2 )) and S = 7 ) 2 > - 1 • 

In view of (1/T)Q = S ex t, the II nd law readily follows 

Q - k B TS = (67) 

7 / d In w \ 2 

( k B T— htmi ) = -TSi n t < 

m \ ou J 

We denote S = k B S and so arrive at Q < TS. As a byproduct of the discussion we have 
F < W. 

For time- independent V = V(x), the extremum principle pertains to minimizing the 
Helmholtz free energy F in the course of random motion: 

F = Q-TS= -TS int < (68) 

The preceding discussion encompasses both the forced and unforced (free) Brownian 
motion. When V(x) = 0, then no asymptotic state of equilibrium (represented by a prob- 
ability density) is accessible, the motion is sweeping. In the forced case we realize that: 
w*(x, u) = T?exp — E j^T 5 i s a stationary solution of the Krames equation. Therefore, we 
may expect that the dynamics actually relaxes to this a (unique) stationary state 9 w — * w*. 
Obviously, w* is non-existent in case of the free Brownian motion. 



C. Thermodynamics of Smoluchowski processes 

Analogous thermodynamical features are encountered in spatial random motions, like 
e.g. standard Smoluchowski processes and their generalizations. Given a probability den- 
sity p(x,t) solution of a Fokker-Planck equation d t p = DAp — V- (bp). The related Shannon 
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entropy S(t) = — (hip) typically is not a conserved quantity and, with boundary restric- 
tions that p, vp, bp vanish at spatial infinities or finite integration interval borders, various 
equivalent forms of the balance equation follow. We select,- 1 ^: 

DS = (v 2 ) - (b ■ v) . (69) 

A thermodynamic formalism for Smoluchowski processes is straightforward. We pass 
to time-independent drift fields and set, while adjusting dimensional constants: b = 
Exploiting j = vp, f = —W and setting D = k B T /m(3 we give Eq. ( 1691) a conspicuous 
form of: 

<S = <Sint + <Sext (70) 

where ksTSmt = m[3 (v 2 ) > stands for the entropy production, while k,BTS ext — Q — 
— J f ■ j dx = —m(3 (b ■ v) (as long as negative which is not a must) may be interpreted 
as the heat dissipation rate: in view of Q — — J f ■ j dx, there is a definite power release 
involved. 

Notice that because of TS = ksTS we do have 

TS int = TS-Q>0^TS>Q. (71) 

In view of j = pv = ^[f - k B TV hip] = -^W i.e. v = -(l/m/3)Vtf and / = -W, we 
can introduce 

^ = V + k B T\np (72) 
whose mean value stands for the Helmholtz free energy of the random motion 

F = (^) = U-TS. (73) 

Here S = k%S and an internal energy is U = (V). 

Assuming that p and pVv vanish at the integration volume boundaries we get 

F = Q-TS = -(m/3) (v 2 ) = -k B TS int < . (74) 

As long as there is a positive entropy production, the Helmholtz free energy decreases as a 
function of time towards its minimum. If there is none, the Helmholtz free energy remains 
constant. 

With the external forcing reintroduced, of particular interest is the regime S = 0. This oc- 
curs necessarily, if the diffusion current vanishes and one encounters the state of equilibrium 
with an invariant density p*. Then, b = u = DVlnp* and — (l/A;^T)VV r = Vln p* implies 
p* = -| exp[— V/ksT]. Hence = V + A^Tlnp* and therefore ( 1 i r *) = — ksTlnZ = F*, 
with Z = j exp(—V/kBT)dx, is a minimum of the Helmholtz free energy F. 

For the free Brownian motion there is no invariant density and we have V = = b, while 
v = -DV lnp = -u, and therefore Q = F = -TS = -m(3D 2 f dx < 0. 
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V. ENTROPY METHODS IN THE SCHRODINGER PICTURE QUANTUM 

DYNAMICS 

A pure state of the quantum system and its Schrodinger picture dynamics are normally 
regarded in conjunction with the notion of a thermodynamically isolated quantum system. 
A standard tool in the thermal context would be the von Neumann entropy notion which is 
known to vanish on pure states and to be insensitive to the unitary quantum evolution. In 
below, we shall pay attention to the Shannon entropy properties in the quantum context 7 , 
to demonstrate that a number of essentially thermodynamical features is encoded in the 
apparently non-thermodynamical regime of the Schrodinger picture quantum dynamics. 

We come back to the Schrodinger evolution of pure states in L 2 (R). We employ the natu- 
ral boundary data (actually, the Dirichlet boundary conditions make the job) and vanishing 
of various expressions at integration boundaries is implicit, in all averaging procedures in 
below. One must be aware that we pass-by a number of mathematical subtleties and take 
for granted that various computational steps are allowed. 

The continuity equation is a direct consequence of the Schrodinger equation. It is less 
obvious that, after employing the hydrodynamical velocity fields u(x,t) and v(x,t), the 
Fokker Planck equation for p = \ijj\ 2 may be deduced. We have: 

d tP = DAp-V-(bp) (75) 

where b = v + u = V(s + D hip) where u = DV In p. 

The Shannon entropy of a continuous probability distribution S = — (hip) follows and 
yields 

DS = (v 2 ) -(b-v) = D(S mt + S ext ) (76) 

which is a straightforward analog of the II nd law of thermodynamics in the considered 
quantum mechanical context: 

S int = S- S ext = {I ID) (v 2 )>0^S> S ext . (77) 

To address an analog of the I st law we need to translate to the present setting the previously 
discussed thermodynamic notions of U and F = U — TS, where the notion of temperature is 
the most serious obstacle. We have no obvious notion (nor physical intuitions about) of the 
temperature for quantum systems in their pure states (for large molecules, like fullerenes or 
the likes, the notion of an internal temperature makes sense, but we aim to consider any 
quantum system in a pure state, small or large). Therefore, we shall invoke a dimensional 
artifice^. 

We formally introduce 

/cbT = hu)Q = mc 2 (78) 
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and thence 

D = h/2m = k B T /mp (79) 
with j3 = 2uo = 2mc 2 /h, and so arrive at the dimensionally acceptable identity 

k B T S ext = Q . (80) 

In view of: 

v = Vs = b — u = V(s + D\np) — DV In p = (81) 
' V(V + k B T \np) = V V ^' 



mf3 ~' mPo 

where the time-dependent potential 

V = V(x,t) = -m(3 (s + D\np) (82) 

is defined to stay in a notational conformity with the standard Smoluchowski process (Brow- 
nian motion in a conservative force field^) definition b = —W/mjSo, we finally get 

-mP(s) = (V) = (y)-ToS=>F=U-TS, (83) 

where U = (V) and F = 

Remembering about an explicit time dependence of b(x, t) = —(l/mP )W(x,t), we 
finally arrive at the direct analogue of the I st law of thermodynamics in the present quantum 
context: 

(j = (d t V) -mPo(bo) = W + Q. (84) 

The term corresponding to the previous "externally performed work" entry reads W = (dtV). 
But: 

V = -mps - k B T\np (d t V) = -m(3 (d t s) = W 

and therefore 

- j t (s) = ~(v 2 } - (fa) ^F = -ToS in t + W (85) 

where Si nt > 0. 

In view of Eq. (|29|) . in the thermodynamical description of the quantum motion, we 
encounter a never vanishing constant work term 

W = m(3 S = /3q(H) . (86) 

The quantum version of the Helmholtz-type extremum principle reads: 

F - mP S = -T S int < . (87) 
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It is instructive to notice that 

T S int = T S-Q>0^Q<T S (88) 

goes in parallel with 

F < W = Pq(H) . (89) 

Let us stress that the non- vanishing "external work" term is generic to the quantum 
motion. If a stationary state is considered, our (H) is equal to a corresponding energy 
eigenvalue. 

For negative eigenvalues, the "work" term corresponds to what we might possibly call 
the "work performed by the system" (upon its, here hypothetical, surrounding). Then F is 
negative and F has a chance to attain a minimum. 

Since bounded from below Hamiltonians can be replaced by positive operators, we may 
in principle view nift^E- = (3q (H) as a positive (constant and non- vanishing) time rate of the 
"work externally performed upon the system". This observation encompasses the case of 
positive energy spectra. Accordingly, F may take both negative and positive values. The 
latter up to an upper bound mj3 £. 

Basic temporal patterns of behavior, normally associated with the non-equilibrium ther- 
modynamics of closed irreversible systems, somewhat surprisingly have been faithfully repro- 
duced in the quantum Schrodinger picture evolution which is known to be time-reversible. 
Nonetheless, we have identified direct analogues of the I st and the II nd laws of thermody- 
namics, together with the involved notions of S int > and S ext = (1/T )Q. One should 
obviously remember about the pre-selected sense of time t G R + , that was employed in our 
discussion. 

An asymptotic t — > oo behavior of the quantum motion is controlled by the analog of the 
II nd law: 

F - W = -m(3 j t ((s) + St) = -T S int < . (90) 

where there appears the work (performed upon or performed by the system) term W = 
(d t V) = m(3o£ value whose sign is indefinite (either positive or negative). 

Let us recall that in classical non-equilibrium thermodynamics the so-called minimum 
entropy production principle 18 is often invoked in connection with the "speed" with which 
a minimum of the Helmholtz free energy is approached. For sufficiently large times, when 
the system is in the vicinity of the stationary (equilibrium) state, one expects that the the 
entropy production TS int > is a monotonically decaying function of time, i.e. that 

p tnt <0. (91) 

The quantum motion obviously looks different. In that case, F may be positive and 
one cannot exclude transitions (including those of an oscillatory nature) from negative to 
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positive F values and back. In certain quantum states, the Helmholtz free energy F may 
have a minimum, a maximum, an infinite number of local minima and maxima, or none at 
all. There is no reason for the minimum entropy production principle to be valid in quantum 
theory, except for very special cases. 

Since the work term is a constant of quantum motion, we have : 

F + T S int = m(3 S =>• F = -Tojfint , (92) 

which formally reproduces the temporal behavior characteristic to Smoluchowski diffusion 
processes, c.f. Eq. (l74|) . There are however "speed" properties which are special to the 
quantum dynamics and have no dissipative counterpart. 

The above time rate formula Eq. ( 1921) . which is common to both quantum and diffusive 
motions scenarios, clearly is consistent with the correlation of a minimum of F with a 
maximum of the Si nt . However,we have as well allowed the reverse scenario i.e. that a 
maximum of F may arise in conjunction with a minimum of Si nt . More complicated, like 
e.g. oscillating, forms of the entropy production- Helmhholtz free energy interplay cannot be 
a priori excluded in the quantum case. 

Remembering that T S int = m/3 (t> 2 ) and exploiting the total mean energy formula, Eqs. 
(1291) and( l55l) . we can identify the respective "speeds" in conjunction with the Schrodinger 
picture quantum motion. In view of Eq. (1921) . the pertinent time rates stay in a definite 
negative feedback relationship.: 

F = +Poj t (m(u 2 ) + 2(V» = ~mPoj t (v 2 ) . (93) 

This observation should be contrasted with the behavior induced by diffusion- type pro- 
cesses, where TdS int /dt = mf3d(v 2 ) / dt. Now, c.f. Eq.f l54"j) . we have 

F = -Pj t (Mu 2 ) + 2<V» = -™Pj t (v 2 ) (94) 

which really makes a difference (in view of the sign inversion in the functional expression 
for F). There is no feedback anymore. 



VI. OUTLOOK 

We have discussed in detail the uncertainty/indeterminacy measures that can be asso- 
ciated with time-evolving probability distributions of two basic origins. We infer them for 
diffusion-type processes and the Schrodinger picture quantum dynamics. 
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There are deep analogies between the quantum dynamics in the Madelung representation 
and the classical Fokker-Planck description of diffusion processes. We have exploited them 
in two complementary ways. 

First, the position- momentum indeterminacy relations for diffusion processes were de- 
duced by a modification of major steps in the quantum procedure, compare e.g. Eqs. (JMj) 
and ( Pf9l) . Second, we have faithfully reproduced in the quantum setting major thermody- 
namic relations between heat, work and free energy by adopting to the quantum formalism 
a number of derivations that were consistently tested in the context of the Smoluchowski 
diffusion processes. 

The minor surprise is that major properties of a non-isolated but closed (we use the ter- 
minology of Ref.— ) random system have been directly reproduced for the quantum system, 
which is normally considered as thermally isolated. Our analysis allows to attribute to the 
quantum system in a pure state major properties of a non-isolated but closed thermodynam- 
ical system. The major difference between the quantum and diffusive behavior, if restricted 
to thermodynamically motivated quantities, can be read out form the rate formulas Eqs. (|93|) 
and (I94j). 

To avoid misunderstandings, let us recall that in the classical situation work, heat and 
free energy have well defined meanings. Work is interpreted as an energy due to macroscopic 
degrees of freedom which perform an ordered motion and are perceived as a source of work. 
Heat is perceived as a thermal energy, while free energy is a maximal amount od energy 
which can be extracted as work. A physical meaning of these three concepts is definitely 
based on a differentiation between the total system, the investigated physical subsystem and 
the sources of work and heat (environment). 

We cannot propose a clean physical picture for deceivingly thermodynamical patterns of 
behavior associated with the quantum dynamics. At the moment we have no satisfactory 
explanation of a possible physical meaning of the "work performed upon" or "work performed 
by" the system, nor heat, for an isolated quantum system. Albeit we have demonstrated 
that this system shows up patterns of behavior that are characteristic for non-isolated closed 
thermodynamical systems, in parallel with those for diffusion-type processes. 

On formal grounds, the present paper exploits properties of — (hip) and of ((Vlnp) 2 ), 
while admitting the time-dependence of p. The functional ((Vlnp) 2 ) plays the major role in 
all our considerations and is responsible for the emergence of indeterminacy relations, both 
in the diffusive and quantum motions. 

The final outcomes of the discussion do heavily rely on the assumed factorization of 
the probability density p. It is accomplished either in terms of two real (time-conjugate) 
functions p = 9 ■ or in terms of two complex conjugate functions p = if) ■ if)*. 
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VII. APPENDIX 

Since the employed thermodynamic formalism may look strange for quantum theory 
practitioners, let us exemplify the previous observations by invoking simple quantum 
motion cases. 

Case 1: Free evolution 
Let us consider the probability density in one space dimension: 

a ( x 2 a 2 



t] = + ADH*)]W 6XP [~ a* + ) (95) 

and the phase function (we recall that tp = p l l 2 exp(is/2D) is adopted) 

, \ 2D 2 xH „ / 2Dt\ 

s ( x > *) = TTTTT^. - D arctan —T ( 96 ) 



a 4 + ADH 2 \ a 2 

which determine a free wave packet solution of the Schrodinger equation with the choice of 
V = and the initial data ip(x,0) = (ira 2 )" 1 ^ 4 exp(— x 2 /2a 2 ). 
One can readily deduce that 

= <""> = a'iXtoH*) ^ 

has an initial value and attains a maximum 2D 2 /a 2 in the large time limit. Moreover, 
there holds 

£ = k(v 2 ) + (u 2 )) = ^, (98) 
2 a 

where (u 2 ) = (2D 2 a 2 )/(a 4 + AD 2 t 2 ). Clearly, an initial value of (u 2 ) is 2D 2 /a 2 , while 
stands for its asymptotic limit. 

The feedback relationship Eq. (192]) sets a link between the speed at which the entropy 
production attains its maximum and the speed at which F decreases towards its minimal 
value F min = m(3 S - T S™£ X , compare e.g. Eq. (EZJ). 

Case 2: Steady state in a harmonic potential 
We choose a harmonic potential V = \uj 2 x in the Schrodinger equation (l2"5|) and consider 
its solution with the probability density: 

1 /2 

p(x ' l) = (2^0) exp [~W {x ~ q[t))2 \ (99) 

and the phase function: 



s(x,t) = (1/m) [xp(t) - (l/2)p(t)q(t) -mDoot) , 



(100) 
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where the classical harmonic dynamics with particle mass m and frequency 00 is involved 
such that q(t) = q cos(W) + (p /mu) sm(ut) and p(t) = p cos(uit) — muqo sm(ujt). 
We have here v = Vs = p(t)/m and therefore: 

D{S) m = ^ (101) 

so that in view of E/m = £ = p\j2vn 1 + ujXq/2 + Duj and Eq. f[57|) . remembering that 
D = kBT/mf3 = h/2m, we get 

F = uk B T + m(3 [^- 2 + o;| - ^] = c^T + /3 K^ - ^] - (102) 

It is interesting to observe that the actual behavior of F(t) depends on a difference of the 
potential and kinetic energies of the classical oscillator. 

Case 3: Stationary state 
Let us make a brief comment on the case of stationary states. We take a harmonic oscillator 
ground state as a reference. The entropy production vanishes, since v = 0. Then, we have 
F = mftoSo = /3qE q , where E Q = hu/2 = mDuj. Therefore 

F(t) = (k B T )ut + const (103) 

and F is a monotonically growing function. 

We recall that presently F = W = (3$Eq. The never ceasing time rate of "work performed 
upon the surrounding" needs to be kept in memory as a distinguishing feature of the quantum 
motion. 

Because of — m/3 (s) = F and (s) = s, we have 

s(t) = -Dut + const , (104) 

as should be the case in the exponent of the stationary wave function i/j = p 1 / 2 exp(is/2D). 
Indeed, -E t/2D = -ut/2 = s{t)/2D - const. 
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